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Description 

FIELD OF THE INVENTION 

5 This invention relates to the field of image display systems, more particularly to methods and systems for detecting 

motion in a video data sequence. 

BACKGROUND OF THE INVENTION 

10 Video image display systems create moving images by rapidly displaying a sequence of still images, or frames. 

Display systems must rapidly produce each new frame in order to create the impression of smooth motion in the video 
sequence. Each frame is formed by displaying an orthogonal array of picture elements, or pixels. During each frame, 
every pixel in the array is assigned its own brightness and color value. Digital systems typically represent a single pixel 
using three values, each value representing the intensity of one of three component colors. 
75 Due to the high frame rate required to smoothly portray moving objects, display systems require a very high data 

throughput. Early television broadcast standards, such as NTSC, developed a technique called interlacing to reduce 
the throughput requirements. Interlaced video systems, such as NTSC. PAL, SECAM, and some HDTV standards, 
transmit each frame as two sub-frames or fields. Each of the two fields that form a frame contain alternate scan lines 
from the frame. The first field typically contains all of the odd scan lines while the second field contains all of the even 
20 scan lines. Because the display forms the two sequential fields so quickly, the viewer's eye integrates the sequential 
fields into a continuous moving display. While the two separate fields are visually integrated into a single frame, flicker 
is reduced by projecting the image fields sequentially. 

Modern image display systems, such as most computer displays and some HDTV standards, are non-interlaced. 
Non-scanned, or simply proscan, since the lines that form each image are scanned sequentially from top to bottom 
25 instead of being divided into two fields. Proscan display systems must have a higher f rame rate than interlaced systems 
in order to avoid visible image flicker. Because of the higher frame rate, proscan systems typically display more infor- 
mation and have a higher resolution than comparable interlaced systems with a lower frame rate. 

Some modern image display systems with relatively high bandwidths convert interlaced video signals to proscan 
in order to improve the display quality. Additionally, some display devices, such as the digital micromirror device (DMD), 
30 utilize proscan data conversion to compensate for a lack of image persistence. 

Proscan conversion can introduce errors, or artifacts, into an image depending on what the video sequence is 
displaying and how the proscan conversion is being performed. A simple form of proscan conversion simply adds the 
even lines from a frame to the odd lines of a frame. Although this form of proscan conversion is preferred for still images, 
it creates problems when displaying moving objects. The problems arise from the fact that the two fields in an image 
35 frame do not represent the image at the same point in time. The image data is created by scanning the original image 
twice, once for every odd line and a second time for every even line, therefore the even-line field represents data one- 
half of a frame period later than the data represented by the odd-line field. The proscan conversion described above, 
which creates current frame images by filling in missing lines with pixel data from the prior field, causes misalignment 
in moving images. This misalignment is most obvious along the edges of a moving object since the edges will appear 
40 jagged. The same effect occurs in the center of a moving object, but unless there is a lot of contrast within the object 
the artifacts are not as noticeable. 

Alternative forms of proscan conversion, which eliminate the effects of motion, are line doubling and line averaging. 
Both line doubling and line averaging use data Irom adjacent pixels of the same field to fill in the missing lines of the 
current field. Line doubling simply displays each line from the present field twice, once in its proper position and once 
45 jn place of the subsequent or preceding line from the next field. When the next field is received, the display again uses 
each line of image data twice, once in its proper position and once in place of the preceding or subsequent line from 
the previous field. Line-averaging systems create a new line of image data based on the average of the image data 
for the lines above and below the created line. Because both the line-doubling and line-averaging methods only use 
data from one time sample, they avoid the problems associated with simply combining the two image fields. Line- 
50 doubling and line-averaging, however, reduce the effective resolution of the image since they use less information to 
generate each image. 

In order to maintain the highest effective resolution while avoiding motion artifacts, proscan conversion systems 
should compensate for motion in the image data. Ideally, the contribution of adjacent pixels from the same video field 
and from the same pixel in adjacent video fields should depend on the amount of motion in the video sequence. There- 
55 fore an accurate motion detection system is needed to allow optimization of the proscan conversion process. 
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SUMMARY OF THE INVENTION 

Objects and advantages will be obvious, and will in part appear hereinafter and will be accomplished by the present 
invention which provides an improved method and system for measuring motion in a video image and for performing 

s a proscan conversion on interlaced video data based on the improved motion measurement. 

According to a first embodiment of the improved method of measuring motion, a field-difference motion value is 
measuring motion, a field-difference motion value is calculated for a missing pixel. This field-difference motion value 
is used to select a proscan algorithm that will accurately de-interlace the video data. 

According to another embodiment of the improved method of measuring motion, a field-difference motion value is 

10 determined by calculating a first prior-field average value equal to the average of same-pixel prior-field image data and 
same-pixel prior-field two-rows-prior image data, and determining the absolute value of the difference between same- 
pixel prior-row image data and the first prior-field average value data. 

According to yet another embodiment of the improved method of measuring motion, a motion value is determined 
by determining a first prior-field average value equal to the average of same-pixel prior-field image data and same- 

15 pixel prior-field two-rows-prior image data : determining a first field-difference motion value equal to the absolute value 
of the difference between same-pixel prior-row image data and the first prior-field average value data. 

According to yet another embodiment of the improved method of measuring motion, a motion value is determined 
by determining a second prior-field average value equal to the average of same-pixel prior-field image data and same- 
pixel prior-field two- rows -later image data, and determining second field-difference motion value equal to the absolute 

20 value of the difference between same-pixel prior-row image data and the second prior-field average value data. 

According to yet another embodiment of the improved method of measuring motion, a first field-difference motion 
value is determined by determining a first prior-field average value equal to the average of same-pixel prior-field image 
data and same-pixel prior-field two-rows-prior image data, determining a first field-difference motion value equal to the 
absolute value of the difference between same-pixel prior-row image data and the first prior-field average value data, 

25 a second field-difference is determined by determining a second prior-field average value equal to the average of same- 
pixel prior-field image data and same-pixel prior-field two- rows -later image data, and determining second field-differ- 
ence motion value equal to the absolute value of the difference between same-pixel prior-row image data and the 
second prior-field average value data, and a minimum of the first and second field-difference motion values is used as 
the field-difference motion value. 

30 According to yet another embodiment of the disclosed invention calculates a field-difference motion value for a 

missing pixel, calculates a frame-difference motion value for a missing pixel, and selects a proscan algorithm based 
on both the frame-difference and the field-difference motion values to select an algorithm for creating data for the 
missing pixel. 

According to yet another embodiment of the disclosed invention, a proscan algorithm is selected based on the 
35 frame-difference motion value when the frame-difference motion value is less than a threshold and using the field- 
difference motion value when the frame-difference motion value is greater than the threshold. 

According to yet another embodiment of the disclosed invention, a proscan algorithm is selected based on the 
frame-difference motion value when the frame-difference motion value is less than a first threshold, using the field- 
difference motion value when the frame-difference motion value is greater than a second threshold, and using a weight- 
40 ed average of the frame-difference and the field-difference motion values to select an algorithm for creating data for 
the missing pixel when the frame-difference motion value is less than the first threshold and greater than the second 
threshold. 

According to yet another embodiment of the disclosed invention, a method of determining a motion value for a 
pixel location in a video signal is provided. The method comprises determining a first frame-difference motion value 
45 by comparing same-pixel prior-row image data from a current frame and a value by comparing same-pixel next-row 
image data from the current frame and the prior frame, and setting the motion value equal to a minimum of the first 
frame-difference motion value and the second frame-difference motion value. 

According to yet another embodiment of the disclosed invention, a method of determining a motion value is pro- 
vided. The method comprises comparing same-pixel prior-row image data from a current frame and a same-pixel same- 
50 row image data from a prior field. 

According to yet another embodiment of the disclosed invention, a logical mixer is provided. The logical mixer 
comprises a first comparator outputting a selection signal indicating whether a first signal is greater than a threshold 
signal, a second comparator outputting a maximum signal equal to the maximum of the first signal and a second signal, 
and a selector receiving the selection signal, the first signal, and the maximum signal, the selector outputting the first 
55 signal when the first signal is less than the threshold signal and outputting the maximum signal when the first signal is 
greater than the threshold signal. 

According to yet another embodiment of the disclosed invention, a display system is provided. The display system 
comprises a video processor for receiving an interlaced video signal and converting the interlaced video signal to a 



3 



EP0 830 018 A2 



10 



35 



progressive-scan video signal, the video processor performs the conversion based on a calculated field-difference 
motion value for the interlaced video signal, and a display for receiving the progressive-scan video signal from the 
video processor and for displaying the progressive scan video signal. 

BRIEF DESCRIPTION OF THE DRAWINGS 

For a more complete understanding of the present invention, and the advantages thereof, reference is now made 
to the following descriptions taken in conjunction with the accompanying drawings, in which: accompanying drawings, 
in which: 



Figure 1 is a graphical representation of five lines of image data from each of three fields of a video data sequence; 
Figure 2 is a block diagram of a frame -difference motion detection system of the prior art; 
Figure 3 is schematic representation of the frame-difference motion detection system of Figure 2 indicating the 
location of the two pixels used to generate a motion value for a third pixel; 
75 Figure 4 is a block diagram of an improved frame-difference motion detection system which uses data from two 

rows ot two frames to generate a motion value for a pixel; 

l-igure 5 is a schematic representation of the improved frame -difference motion detection system of Figure 4 in- 
dicating the location of the four pixels used to generate a motion value for a fifth pixel; 

Figure 6 is a block diagram of a field-difference motion detection system which uses same-line-previous-field data 
20 and pievious-lme-same-field data to generate a motion value for a pixel; 

Filju.c 7 n schematic representation of the field-difference motion detection system of Figure 6 indicating the 
location o* the two pixels used to generate a motion value for a third pixel; 

r.gurc c «s h block diagram of an improved motion detection system which uses both field and frame-difference 
techniques lo generate a motion value for a pixel based on data from five rows and three frames of pixels; 
25 Figure 0 is a schematic representation of the improved motion detection system of Figure 8 indicating the location 

of the seven pixels usod to generate a motion value for an eighth pixel; 

Figure 10 is a block diagram of one embodiment of the logical mixer of Figure 8 used to combine the results from 
a field-difference motion detection subsystem and a frame-difference motion detection subsystem; 
Figure 1 1 is a block diagram of a second embodiment of the logical mixer of Figure 8 used to combine the results 
30 from a field-difference motion detection subsystem and a frame-difference motion detection subsystem; 

Figure 1 2 is a block diagram of a third embodiment of the logical mixer of Figure 8 that performs a soft-switching 
function by gradually shifting from a frame-difference output to a field-difference output; and 
Figure 13 is a block diagram of a display system having a video processor that uses both frame-difference and 
field-difference motion detection. 



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 



Figure 1 schematically depicts video data for five adjacent image lines from each of three sequential fields. Each 
line of real image data, image data transmitted from the interleaved source, is designated by a solid line. Each line of 

40 created image data, data generated by the proscan conversion, is designated by a dashed line. The spatial relationship 
between image lines within a single field is shown in Figure 1 which shows the five rows, r_ 2 , r.-,, r 0 , r v and r 2 , arranged 
vertically adjacent to each other. The current line, the line for which motion vectors are presently being calculated, is 
row r 0 . Three sequential fields, f_ 2 , f. lf and f 0 , are shown in chronological order from left to right. The current field, the 
field for which motion vectors are presently being calculated, is f 0 . As shown in Figure 1, field f_ 2 is comprised of the 

45 odd-numbered rows, r. n and r v of a first frame, field f.-, is comprised of even-numbered rows r_ 2 , r 0 , and r 2 , and field 
f 0 is comprised of the odd-numbered rows, r.-, and r-,, from a second frame. 

The dark circle on each of the image lines represents a single pixel in the row of pixels. Unless otherwise specified, 
the pixel indicated in each row of a figure is the same pixel from each row, i.e. the pixel occupying the same horizontal 
position in each of the rows indicated, proscan conversion to create image data for pixel 102 in row r 0 of field f 0 from 

50 data for pixels 104, 108, and 110 of an interlaced video signal. Typical motion detection algorithms subtract the pixel 
data of pixel 104 from the pixel data of pixel 106 and use the magnitude of the difference between the two pixels as a 
rough estimate of the amount of motion in the portion of the image depicted by pixel 102. If no motion is detected, the 
proscan conversion algorithm simply uses the data from pixel 108 for pixel 102. If a lot of motion is detected, the 
average of the image data from pixel 1 04 and pixel 11 0 is used for pixel 1 02. For intermediate motion values, a weighted 

55 average of the data from each of the three pixels is used with the weights selected to transition smoothly from the no 
motion use of data from pixel 108 to the high motion use of data from pixel 104 and pixel 110. For example, the image 
data for pixel 102, ID 102> is determined by: 
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ID 102 = < k * ,D io 8 ) + (1-kr(ID 104+ ID 110 )/2 

where ID X is the image data for pixel x, and k is the magnitude of the detected motion ranging from zero to one. Since 

5 there is no need to generate image data for the image lines which are transmitted in each field, the motion detection 
algorithm is only used on alternate lines within each field. 

Figure 2 is a block diagram of a motion detection system 200 according to the prior art. In Figure 2, delay block 
202 delays the current image data 204 for one field period. Summation block 206 subtracts the delayed image data 
208 from the current image data 204. The output of the summation block 206 is a number representing the detected 

10 motion at the current image pixel. Block 210 determines the absolute value of the number representing the detected 
motion and block 212 scales the absolute value. Non-linear scaling block 212 typically subtracts a minimum threshold 
value from the absolute value and limits, or clips, the result to a maximum value. The minimum threshold provides 
some immunity to noise on the motion signal while the maximum value narrows the range of motion values that must 
be considered by the proscan of motion values that must be considered by the proscan algorithm. 

is in practice, the minimum threshold values determine the point at which the proscan conversion algorithm starts 

using current field data to generate image data, the point at which k is greater than zero in the previous equation, while 
the limiting value determines the point at which the proscan conversion algorithm stops using data from a previous 
field to generate image data, k equals 1. Therefore, the frame-difference algorithm of Figure 2 uses current field and 
previous frame data to determine a motion value, k, which controls how image data is created from current field and 

20 previous field data. 

Figure 3 depicts the operation of the frame-difference algorithm shown in Figure 2. In Figure 3, motion data for 
pixel 302 is generated by subtracting the prior frame adjacent pixel 306 (f_ 2 , r.-,) data from the current frame adjacent 
pixel 304 (f 0 , r.-,) data. Not shown in Figure 3 are the absolute value or the non-linear scaling functions of Figure 2. 
Depending on the motion value determined for pixel 302, image data for pixel 302 is created using image data from 
25 pixels 304, 308, and 310. 

An improved frame-difference system and algorithm, which uses data from adjacent rows above and below the 
missing data line is depicted in Figures 4 and 5. In Figures 4 and 5, the image data for row r 0 is generated using data 
from rows r^ and r, . In Figure 4, the current image data 402 is compared to image data from the previous frame 404, 
and image data from the previous line 406 is compared to image data from the previous line of the previous frame 408. 
30 Magnitude scaling blocks 410, and 412, scale the absolute value of the results of these comparisons resulting in a 
motion value 414 for the line below the missing line and a motion value 416 for the line above the missing line. These 
two motion values are compared and the minimum motion value 41 8 is used to influence the proscan algorithm. Instead 
of merely selecting the to select the maximum motion value, or a weighted average of the two calculated motion values 
414 and 416. Figure 5 graphically shows the data flow through the system of Figure 4. The absolute value/non-linear 
35 scaling functional blocks, 410 and 412, of Figure 4 are not shown in Figure 5. 

The frame-difference systems and algorithms represented by Figures 2-5 reliably measure the image motion in 
still, or low-motion video sequences. They may, however, fail to detect motion in very high-motion image sequences 
due to the relatively slow sample rate of the input data. 

An alternative to the frame-difference systems and algorithms of Figure 2-5 is the field-difference motion detection 
40 system 600 of Figure 6. In Figure 6, the frame delay of Figure 2 has been replaced by a field delay 602. Referring to 
Figure 7, the field-difference system 600 of Figure 6 compares transmitted image data from pixels 702 (f 0 , r.-,) and 704 
0.1. »b) to generate a detected motion value for pixel 706 (t 0 , r 0 ). As in the frame-detection system of Figure 2, the 
magnitude of the detect motion value is scaled by non-linear scaling block 212 before it is used to control the proscan 
conversion algorithm. 

45 The advantage of the field-difference motion detection system 600 of Figure 6 is its enhanced ability to detect rapid 

motion compared to the detection system of Figure 2. The enhanced detection ability is due to the increased sample 
rate of the field-difference motion detection system 600 compared to the frame sample rate used by the detection 
system 200 of Figure 2. The field-difference motion detection system 600 uses current field (f 0 ) and previous field (f. t ) 
data instead of current frame and previous frame data to determine a motion value which controls how image data is 

50 created from current field and previous field data. 

Unfortunately, while the field-difference motion detection system 600 detects very high rates of motion, it also 
generates false motion values when the processed image has a high vertical image frequency since the two data 
values has a high vertical image frequency since the two data values being compared are from different rows of the 
image. The image data in each line in an image with a high vertical image frequency is very different from the image 

55 data in adjacent lines. Therefore, when the field-difference motion detection system 600 compares data from pixel 702 
with data from pixel 704, the line-to-line difference in still image data is interpreted as motion. 

To overcome the problems inherent with frame-difference and field-difference motion detection systems, a new 
detection system has been developed. The disclosed motion detection system 800 is shown in Figure 8. Figure 9 
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depicts the logical operation of the motion detection system 800 on image data. The new motion detection system of 
Figures 8 and 9 determines the motion vector for each pixel in each of the missing rows by measuring and comparing 
four different motion vectors. First, the system of Figures 8 and 9 measures the frame-difference motion vector for the 
same pixel, the pixel in the same horizontal location, in the lines immediately above and below the pixel of interest. 

5 Then, the system measures the field-difference motion vector for the same two pixels. The lesser of the two frame- 
difference motion vectors and the lesser of the two field-difference motion vectors are input into a logical mixer and 
used to determine the motion vector to be assigned to the current pixel. 

Figures 8 and 9 show the steps used to calculate these four motion vectors. As shown in Figure 8, one frame- 
difference motion value is computed by comparing the current image data 802 from pixel 902 (f 0 , r,) ol Figure 9 with 

10 image data 804 from the same pixel of the previous frame 904 (f_ 2 , r-,) using block 805 while the second frame-difference 
motion value is computed using image data 808 from the same pixel of the previous line 906 (f 0 , r.-,) and image data 
810 from the same pixel of the previous line of the previous frame 908 (f. 2> r.-,) by block 809. Comparator 817 outputs 
the minimum value of these two comparisons as the frame-difference motion value 816 of Figure 4. 

The motion detection system of Figure 8 also calculates a minimum field-difference motion value 818 by averaging 

is the image data from pixels 910 (f.-, , r 0 ) and 912 (L,, r_ 2 ) and comparing the average to the image data value from pixel 
906 (f Q: r.-,) . The result is compared with a second field-difference value determined using data from pixels 902 (f 0> 
r i. 910 (f.-,, r 0 ), and 914 (f.-,, r 2 ), and the minimum of the two operations is the minimum field-difference value 818. 

Although Figures 8 and 9 each show selecting the minimum field-difference motion value 818 and the minimum 
frame-difference motion value 814 of the two values created, the motion detection system 800 could also select the 

20 maximum motion value, the average motion value, or a weighted average of the two motion value depending on the 
application. 

The minimum frame -difference motion value 816 and the minimum field-difference motion value 81 8 are both input 
into a logical mixer 820. The logical mixer 820 outputs a motion value which is then smoothed by an optional vertical 
maximum detector 822 and an optional vertical/horizontal low pass filter 824 before being scaled by an optional non- 
25 imcar scaling function 826. The vertical maximum detector 822 compares the motion value of the current line with the 
motion value for a pixel in the same location of the previous, current, and next lines, and uses the maximum of the 
three values as the current pixel's motion value. The vertical maximum detector 822 and the vertical/horizontal low 
pass filter 824 both operate to smooth the output of the motion detection system 800. This smoothing helps to prevent 
visual artifacts from being introduced between regions in which motion is detected and those in which no motion is 
30 detected Additionally, a non-linear scaling block 826, which typically subtracts a minimum threshold value from the 
motion value and limits, or clips, the result to a maximum value, also operates to smooth the motion value determined 
by the circuit of Figure 8. 

The disclosed motion detection circuit relies on a new logical mixer 820 to determine the proper motion value. The 
logical mixer 820 is critical to obtaining the accurate motion data from the field and frame-difference portions of the 

35 motion detection system 800. Because the frame-difference portion of the motion detection system 800 is very accurate 
for low frequency motion, the logical mixer block outputs the results of the frame-difference subcircuit when the detected 
motion value is low. When the detected motion value is high, however, the logical mixer block outputs the results of 
the field-difference subcircuit. 

To summarize Figures 8 and 9, a motion value for the current pixel 900 is determined by first finding a field-difference 

40 motion value 818 and a frame-difference motion value 816 and inputting the field-difference motion value 818 and 
frame-difference motion value 816 into logical mixer 820. The frame-difference motion value is the minimum of two 
frame-difference motion values obtained using adjacent data from the same field (f 0 ) and the previous frame (f_ 2 ). The 
first frame-difference motion value is the absolute value of the difference between image data 806 from the same pixel 
906 in a prior row (r.-,) of the same field (f 0 ) and image data 808 from the same pixel 908 in the prior row (r^) of the 

45 prior frame (f_ 2 ). The second frame-difference motion value is the absolute value of the difference between image data 
802 from the same pixel 902 in a following row (r^ of the same field (f 0 ) and image data 804 from the same pixel 904 
in the following row (r,) of the prior frame (f_ 2 ). In other words, the frame-difference motion value is the minimum 
absolute value obtained by comparing same-pixel adjacent-row same-field image data 802, 806, with same-pixel ad- 
jacent-row prior-frame image data 804, 808. 

50 Also input into the logical mixer is the field-difference motion value. The field-difference motion value is the minimum 

of two field-difference motion values obtained using adjacent data from the same field (f 0 ) and the previous field (f.-,). 
The first field-difference motion value is the absolute value of the difference between image data 806 from the same 
pixel 906 of tho prior row (r.-,) of the same field (f 0 ) and the average of image data 810 from the same pixel 910 of the 
same row (r 0 ) of the prior field (f^) and image data 812 from the same pixel 912 of two rows prior (r_ 2 ) in the prior field 

55 (f, ( ) . The second field-difference motion value is the absolute value of the difference between image data 802 from 
the same pixel 902 of the following row (r.,) of the same field (f 0 ) and the average of image data 810 from the same 
pixel 910 of the same row (r 0 ) of the prior field (f.-,) and image data 814 from the same pixel 914 of two rows following 
(r 2 ) in the prior field (L,) . In other words, the field-difference motion value is the minimum absolute value obtained by 
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comparing same-pixel adjacent-row same-field image data 802, 806, with the average of same-pixel same-row prior- 
field image data 810 and same-pixel two-rows-adjacent prior-field image data 812, 814. Combining the teachings of 
Figures 6 and 7 with that of Figures 8 and 9, image data 810 could be substituted for the average of image data 810 
and the data 812, 814, from the same pixels 912, 914, two rows adjacent (r_ 2 , r 2 ) in the prior field (f.,). 

5 Figure 10 shows one embodiment of a logical mixer according to the present invention. In Figure 10, the minimum 

frame-difference value (MFR) is compared to a threshold value (TH) by comparator 1002. If the minimum frame-dif- 
ference value is greater than the threshold, then the greater of the frame-difference motion value and the field-difference 
motion value is output by selector 1004. The logical mixer 1000 of Figure 10 selects the frame-difference motion value 
when there is only a small amount of motion in the image and the greater of the frame and field-difference motion 

10 values when there is a lot of motion in the image. The result is that the frame-difference motion value, which is very 
accurate, is used except when both the field-difference value is greater and the frame-difference value is significant. 
This allows the faster field-difference value to be used without the fear of falsely detecting motion in still images. 

Figure 1 1 shows a second embodiment of a logical mixer where the threshold value is three. In Figure 1 1 , whenever 
either one or both of the two most significant bits, MFR[3) or MFR[2], is set, the maximum of the minimum frame 

15 difference (MFR[3:0]) and minimum field difference (MFI[3:0]) motion values is used by the display system to calculate 
a current pixel motion value. 

Figure 12 shows an embodiment of a logical mixer 1200 that implements a soft switching function. In Figure 12, 
comparator 1202 compares the minimum frame difference motion value (MFR[3:0]) to a lower threshold (THA), an 
intermediate threshold (THB), and an upper threshold (THC), and outputs a signal to multiplexer 1204 to indicate which 

20 thresholds, if any, the minimum frame difference motion value exceeds. The minimum frame-difference motion value 
is output by selector 1202 whenever it is less than a lower threshold (THA), and the maximum of the field and frame- 
difference values is used when the minimum frame-difference motion value is above an upper threshold (THC). When 
the minimum frame-difference value is above the lower threshold, but below the upper threshold (THC), a weighted 
average of the minimum frame-difference and the minimum field-difference values, determined by averaging circuitry 

25 1206, is used. In the example shown in Figure 12, an intermediate threshold (THB) is used to allow one of four com- 
binations of the frame and field-difference values to control the proscan algorithm. 

Figure 1 3 shows one embodiment of a display system including the disclosed motion detection system. In Figure 
1 3, video data is received by receiver 1302. The video processor 1304 includes the disclosed motion detection system 
and uses the disclosed motion detection system to process the received video data. The processed video data is then 

30 output to display device 1 306 for display. 

Although to this point the disclosed motion detection Although to this point the disclosed motion detection system 
has been described in terms of block diagrams implementing the system, it should be understood that the system can 
be implemented in many ways, including hardware and software components. Table 1 below is a listing of a software 
program implementing the disclosed motion detection system. 
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Table 1 

* + + + 



CODE FOR MOTION DETECTION COMPARISON DEMO 
; * (ONE ALGORITHM ON ONE SCREEN) 

;* This code is for "Motion Detection using Field and Frame 

;* Difference, up to Logical Mixer" algorithm 
. * 

; * lib : mac0_310.1ib 

;* assembler : asm_4 04.exe 

. * 

; * Imodes : 

.* im = 1 : Motion Detection using Field/Frame 

Difference * 

.* . Im = 2 : Motion Detection using Field Difference 

.* Im = 3 : Motion Detection using Frame Difference 

• * im = 4 : Pass through 
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Im = 5 : Pass through 

Im = 6 : Pass through 

* Im = 7 : Left Output = 2, Right Output = 1 

* Im = 8 : Left Output = 3, Right Output = 1 

* Im = 9 : Left Output - 1, Right Output = 2 

* Im =10 : Left Output = 1, Right Output = 3 

* Im =11 : Left Output = 1, Right Output = 4 

* Im =12 : Left Output = 1, Right Output = 5 

* Im =13 : Left Output = 1, Right Output = 6 

* Im =14 : Left Output = 6, Right Output = 4 

* Im =15 : Left Output = 5, Right Output = 4 



Imodes 7 through 15 are not available with this program. 



ERI 

.width 132 

.mlib c: \svp\lib\mac0_310. lib 

.mlib c:\lib\macO 310. lib 



9 



EP 0 830 018 A2 



********** 



RF Regions 



********** 



RFO: 



10 



15 



20 



25 



30 



35 



40 



45 



SO 



VMOO .setO 0 

Mixer Output 

VLOC .setO 4 

Max Function Output 

VM01 .setO 8 

Mixer Output 

VL01 . setO 12 

Max Function Output 

VM02 .setO 16 

Mixer Output 

VL02 . setO 20 

Max Function Output 

VM03 .setO 24 

Mixer Output 

VL03 .setO 28 

Max Function Output 

VM04 .setO 32 

Mixer Output 

VL04 .setO 36 

Max Function Output 



/ OH delayed Logical 
; OH delayed Vertical 

; 1H delayed Logical 
; 1H delayed Vertical 

; 2H delayed Logical 
; 2H delayed Vertical 

; 3H delayed Logical 
; 3H delayed Vertical 

; 4H delayed Logical 
; 4H delayed Vertical 



D01 


.setO 


50 


; Scratch 


memory 


D02 


. setO 


60 


; Scratch 


memory 


D03 


.setO 


70 


; Scratch 


memory 


LOO 


. setO 


81 


; Scratch 


memory 


L01 


. setO 


91 


; Scratch 


memory 


FO 


.setO 


127 


; Scratch 


memory 


RF1 : 










E10 


.setl 


0 


r 


262H delayed 


Luminance 








Ell 


. setl 


8 


t 


2 63H delayed 
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10 



15 



20 



Luminance 

E12 .setl 

Luminance 

F10 .setl 

Luminance 

Fll .setl 

Luminance 

F12 .setl 

Luminance 

D10 . .setl 

Dll .setl 

Luminance 

D12 .setl 

Luminance 



48 



16 
24 
32 
40 

56 
64 



; 264H delayed 

; 524H delayed 

; 52 511 delayed 

; 526H delayed 

; Luminance 

; 1H delayed 

; 2H delayed 





Tin cpf 1 


*7 9 

/ £, 




ocraucn memoiry 




Lll .setl 


76 


r 


Scratch memory 


25 


L12 .setl 


80 


f 


Scratch memory 




Fl .setl 


127 


f 


Scratch memory 




DOR 








30 












MMO .set 


8 




; Motion Magnitude 




Output 








35 


YOUT .set 


0 








DIR 








40 


r 

Y .set 


0 


f 


Luminance 




Y262 .set 


32 




; 262H delayed 




Luminance 








45 


Y524 .set 


8 




; 524H delayed 




Luminance 










IrmO 


40, 8 






SO 


lrml 


72, 8 







55 



11 



EP0 830 018 A2 



IG Code 



10 



15 



20 



25 



hsyncl : j f az $ 

mov out'MMO, RO'LOO+l^ 
Motion Magnitude 

mov out'YOUT, R0'D03'8 
Luminance 



30 



grlO 
grll 

umr 

mov 
mov 

Luminance 
mov 

Luminance 



; Wait for Flag A 

; output Left half 
; output Left half 



; Global Rotate RFO 

; Global Rotate RF1 

; Update Mode Resister 

Rl'DlO, inp'Y'S ; input Luminance 

Rl'ElO, inp'Y262 f 8 ; input 262H delayed 



Rl'FlO, inp' Y524 ' 8 



; input 52 4H delayed 



35 



40 



45 



50 



]me 

mov 
Luminance 

jmp 

;lum: mov 



lum, 2 
R0 f DO3, R1 , D12'8 
next 



; D03 = 2H delayed 



next: jme 
jump to hsyncl 

jme hsyncl, 5 

to hsyncl 

jme hsyncl, 6 

to hsyncl 



R0'D03, Rl'DlO'8 

; Pass Through Mode 
hsyncl, 4 ; if Imode=4, then 



; if Imode=5, then jump 
; if Imode=6, then jump 
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mov RO'LOO, Rl'Fll'8 ; LOO = 525H delayed 

Luminance 

mov RO'LOl, R1 ! F12'8 ; L01 = 526H delayed 

Luminance 

mov RO'DOl, Rl'Ell'S ; D01 = 263H delayed 

Luminance 

mov R0 f D02 / Rl f E12 f 8 ; D01 = 264H delayed 

Luminance 

Motion Detection using Field 

Di fference 

jme mfi, 2 ; if Imode = 2, then 

: ui;t[. to MFI 

.♦.WW******** MFR 

; Frame Difference 1 

; * 4 *************** * Subtraction 1 



Subtract from Previous Frame 



35 



{ 52 bH delayed Luminance - Luminance ) 



40 



45 



mf r: sub 



RO'LOO, R0'L00 f 8, RADIO'S, 0 

; LOO = 525H delayed Luma - Luma 



so 



Absolute / Non-Linear Function 1 



55 
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15 



20 



;* Absolute Previous result, and add -4 
* 

;* ( ABS(LOO) + (-4) ) 

* 

10 

* 

; *************************************^ 

******-*** 

abs RO'LOO, RO'LOO'9, 1 ; LOO = ABS(LOO) 

addc RO'LOO, -4M, RO'LOO'9, 1 

; LOO = LOO + (-4) 
clpzt RO'LOOM, RO'LOO'lO, Rl 1 Fl 

/ Clip LOO (11 bits) to (4 bits) and 

save 

25 .★***************** Frame Difference 2 

*****************-*************** 

.********* * ***** **»* Subtraction 2 

*************************************** 

. * 

* 

;* Subtract from 1H delayed Previous Frame 

35 * 

;* ( 52 6H delayed Luminance - 1H delayed Luminance ) 

* 

. * 

40 

* 

.**********•****************** + ******-******•*************** + **** 
********* 

4 5 sub RO'LOl, RO'LOi'8, Rl 1 Dll ' 8 , 0 

; L01 = 52 6H delayed Luma - 1H 

delayed Luma 



50 



55 



; ****************** Absolute / Non-Linear Function 2 
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; * Absolute Previous result, and add -4 
★ 



( ABS (L01) + (-4) ) 
to + 



abs RO'LOl, RO'LOl'9, 1 ; L01 =ABS(L01) 

addc RO'LOl, -4'4, RO'LOl' 9, 1 

20 ; L01 = L01 + (-4) 

clpzt Rl'Lll'4, RO'LOl'lO, Rl'Fl 

; Clip L01(ll bits) to (4 bits) 
; and save to Lll 

Min Funciton for MFR 



;* Take the smaller of Frame Difference 1 and 2 



;* ( MIN<L00, Lll) ) 

35 * 



+ ■*■ + + ■*★ + **• 



min RO'LOO, RO'LOO, Rl'Lll'4, RO'FO, 0 

; LOO = MIN(L00, Lll) 

Motion Detection using Frame 

Difference 

jme move, 3 ; if Imode=3, then jump 

to MOVE 
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.***■*************** MFI 
******* *****************.**.***************.****** 

; ***************** * Field Difference 1 

***★**★*****************.****.**** 

******************* Line Average 1 

************************************ 

;* 

* 

;* Take line average of 262H delayed Luminance and 263H 
delayed * 

;* Luminance, and subtract from present Field Luminance 
* 

20 ;• ( Luminance - 1/2 * (262H delayed Luma + 263H delayed 

Luna' ) * 



w 



75 



25 



45 



50 



. ********* A * * * + + + * + + + + + + + * + + + + + + + + + + + + * + + + + + + + + + + + + + + 

********* 



mfi: add RO'DOl, RO'DOl'8, Rl'ElO'8, 0 

so ; D01 = 2 62H delayed Luma + 2 63H 

delayed Luma 

; D01 = (1/2) * D01 
sub RO'DOl+l, Rl'DlO'B, RO'DOl+l'S, 0 

35 ; D01 = (1/2)*D01 - Luminance 

; ****************** Absolute / Non-linear Function 1 
******************* 

40 



;* Absolute Previous result, and add -4 
* 

;* ( ABS (D01) + (-4) ) 
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5 abs RO'DOl+l, RO'DOl+1'9, 0; D01 =ABS(D01) 

addc RO'DOl+l, -4'4, RO'DOl+1'8, 1 

; DOl = D01 + (-4) 
Clpzt RO'DOl+1'4, RO'DOl+l'S, Rl ' Fl 

10 ; clip DOl (11 bits) to (4 bits) and 

save 



15 



20 



30 



SO 



Field Difference 
.*•*★*★★*★*■********* Line Average 



;* Take line average of 263H delayed Luminance 264H delayed 

25 ;* Luminance, and subtract from 1H delayed Field Luminance 

;* { 1H delayed Luminance - 

;* (263H delayed Luma + 264H delayed Luma) 



35 * 

.++++**++*+*+**+*+++**++**++★+++**+*******'+*+*****+**+******** 
w 

add R0'DO2, R0'DO2'8, Rl'Ell'S, 0 

40 

; D02 = 263H delayed Luma + 264H 

delayed Luma ^ 

; D02 = (1/2) * D02 
45 sub RO , D024-1, Rl'Dll'8, R0'D02+1'8, 0 

; D02 = (1/2) * D02 - 1H delayed 
Luma f 



. ****+★******+**+++ Absolute / Non-linear Function 2 
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. * 

5 

;* Absolute Previous result, and add -4 

;* ( ABS(D02) + (-4) ) 

10 * 



15 



20 



********* 

abs R0'D02+1, R0'D02+1 , 9 / 0; D02 = ABS(D02) 

extending 1 bit 

addc R0'D02+1, -4M, R0 , D02+1 , 8, 1 

; D01 = D01 + (-4) 
clpzt R1'L12'4, RO , D02 + 1 ' 9, Rl 1 Fl 

; Clip D02{11 bits) to (4 bits) 
25 ; and save to L12 

.****************** Min Function for MFI 

****************************** 

. * 
t 

30 

* 

;* Take the smaller of Field Difference 1 and 2 
* 

35 ;* ( MIN(D01 + 1, L12) ) 



40 .************************************************************* 
********* 

min R1'L12, R1'L12, RO'DOl+lM, Rl'Fl, 0 

; L12 = MIN(L12, D01) 

45 

Motion Detection using Field 

Difference 

so jme max3, 2 ; if Imode=2, then jump 
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to MAX 3 

. Logical Mixer 

5 

lmix: mov Rl'LlO, RO'LOOM ; L10 = MFR 

io .****************** Create Select Signal 



75 
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40 
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By taking NOR of MSB and 2nd MSB, create Select Signal 



( NOR (MSB of MFR, 2nd MSB of MFR) ) 
★ 



************************************************************** 

or Rl'LlO+3, Rl'LlO+3, RO • LOO+2 1 1 

; L10+3 = OR (MSB of MFR, 2nd MSB of 

MFR) 

not Rl'LlO+3, Rl f L10+3 f l ; L10+3 = NOT(L10+3) 

;★*★*** + *** + ****+*.* Max Function 



;+ Take max of MFR and MFI 
;* ( MAX (MFR, MFI) ) 



********* 

max R1 ! L12, R1'L12, RO'LOOM, Rl'Fl, 0 
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; L12 = Max (MFR, MFT ) 
.***********-*■*■***** Selector 



; * Select MFR or Max of MFR and MFI, depending on Select 
Signal * 

r 

* 

-************-***-*^*************^ 
r 

********* 

kmov R1'L12, R0 f L00M, Rl'LlO+3 

; Select : if L10 + 3 = 1, L12 = 

LOO (MFR) 

if L10+3 = 0, L12 = L12 
jmp max3 ; Jump to MAX 3 

.********+********* 3 Line Max Function 

move: mov R1'L12, RO'LOOM ; L12 = LOO = MFR Min 

Function Output 

max3: mov RO'VMOO, R1'L12 , 4 ; VM00 = L12 = 

Logical Mixer Output (LMO) 

max R1 , L12 / R1 , L12 / RO'VMOIM, RO'FO, 0 

; L12 = MAX(VM00, 1H delayed LMO) 
max R1 , L12 / R1 T L12, R0'VM02'4, RO'FO, 0 

; L12 = MAX(L12, 2H delayed LMO) 

; ****************** 5 Line Vertical Max Function 

********************** 

max R1 , L12 / R1'L12, R0 , VM03 , 4 / RO'FO, 0 

; L12 = MAX(L12, 3H delayed LMO) 
max R1'L12, R1 , L12 / R0 f VM04M, RO'FO, 0 



083001 8A2J_> 
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; L12 = MAX(L12, 4H delayed LMO) 
.+++4**++**+******* Vertical Low Pass Filter 



10 ;* 1/4 T"-2 + 1/2 T*-l + 1/2 + 1/2 T A 1 + 1/4 T"2 

+ 

* + + + + + + 



15 



20 



mov RO'VLOO, Rl 1 L12 1 4 ; VLOO » L12 

add R1 T L12, R1 , L12 , 4 / RO'VL04'4, 0 

; L12 = VLOO + 4H delayed VLOO 
; L12 = 1/2 * L12 
add R1 , L12+1 / R1 , L12+1 , 4 / RO'VLOIM, 0 

25 ; L12 = L12 + 1H delayed VLOO 

add R1'L12+1, Rl'L12+l f 5, R0 , VL02 , 4 / 0 

; L12 = L12 + 2H delayed VLOO 
add R1'L12+1, R1'L12+1'6, R0 f VL03M # 0 

; L12 = L12 + 3H delayed VLOO 



30 



35 



45 



; +***************** Horizontal Low Pass Filter 



;* H(z) = (z~-l + z-1) (z"-2 + z A 2) (z A -l + l)(z~l + 1) * 1/8 

40 * 



+ + + + + + 



add RO'LOO-3, LR1 1 L12 + 2 1 6, RRl f L12+2 , 6, 0 

; LOO = Left(L12) + Right(L]2) 
so add R0 f L00-3, L2R0 ? L00-3 ' 1, R2R0 ' L00-3 ■ 7, 0 
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; LOO = 2Left(L00) 4- 2Right(L00) 
add RO'LOO-3, LRO'LOO-3'8, RO'LOO-3'8, 0 

s ; LOO = Left (LOO) + LOO 

add R0'L00-3, RRO'LOO-3,9, RO'7,00-3'9, 0 

; LOO = Right (LOO) + LOO 

10 .****************** Non-linear Function 

r 

******************************** 
. * 

* 

;* add -2 to previous result and divide by 2 



75 



20 



30 



********* 

set RO'LOO+7, 0,1 ; sign LOO 

25 addc RO'LOO, -2,3, RO'LOO' 8, 1 

; LOO = LOO + (-2) 
; LOO = 1/2 * LOO 
clpzt RO'LOO+1'4, RO'LOO+1'8, Rl ' Fl 

; Clip LOO (8 bits) to (4 bits) and 



save 

35 jnip 
hsyncl 



hsyncl ' Jump and wait for 



. end 

40 .**★***************** EOF 

************************************ * * * * * 



45 Thus, although there has been disclosed to this point a particular embodiment for a motion detection system and 

a method thereof, it is not intended that such specific references be considered as limitations upon the scope of this 
invention except in-so-far as set forth in the following claims. Furthermore, having described the invention in connection 
with certain specific embodiments thereof, it is to be understood that further modifications may now suggest themselves 
to those skilled in the art, for example, later data fields, if available, could also be used to determine the motion of the 

50 image data, it is intended to cover all such modifications as fall within the scope of the appended claims. 



Claims 

55 1. A method for converting interlaced video data to progressive scanned data, comprising: 

calculating a field-difference motion value for a missing pixel; and 
selecting a proscan algorithm based on said field-difference motion value. 
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2. The method of Claim 1 , wherein said step of calculating a field-difference motion value comprising: 

determining the absolute value of the difference between same-pixel adjacent-row same-field image data and 
same-pixel same-row prior-frame image data. 

£ 

3. The method of Claim 1 , wherein said step of calculating a field-difference motion value comprising: 

determining a first field-difference motion value equal to the absolute value of the difference between same- 
pixel prior-row image data and same pixel prior-frame image data; and 
10 determining a second field-difference motion value equal to the absolute value of the difference between same- 

pixel following-row image data and same pixel prior-frame image data. 

4. The method of Claim 3, further comprising the step of: 

is selecting a minimum of said first and second field-difference motion values as said field-difference motion 

value. 

5. The method of Claim 2, wherein said step of calculating a field-difference motion value comprising: 

20 determining a prior-field average value equal to the average of same-pixel . same-row prior-field image data 

and same-pixel two- rows-adjacent prior-field image data; and 

determining the absolute value of the difference between same-pixel adjacent-row image data and said prior- 
field average value data. 

25 6. The method of any preceding Claim, further comprising the step of: 

subtracting a minimum threshold value from said field-difference motion value. 

7. The method of any preceding Claim, further comprising the step of: 

30 

limiting said field-difference motion value to a maximum value. 

8. The method of any preceding Claim, said calculating step comprising: 

35 calculating a first field-difference motion value for a missing pixel; 

calculating a second field-difference motion value for a pixel one row after said missing pixel; and 
selecting a maximum of said first, second, and a third field difference motion value as said field-difference 
motion value for said missing pixel. 

40 9. The method of any of Claims 2 to 8, wherein said step of calculating a field-difference motion value comprising: 

determining a first prior-field average value equal to the average of same-pixel prior-field image data and 
same-pixel prior-field two-rows-latter image data; and 

determining second field-difference motion value equal to the absolute value of the difference between same- 
45 pixel prior-row image data and said second prior-field average value data. 

10. The method of Claim 9, further comprising the step of: 

selecting a minimum of said first and second field-difference motion values as said field-difference motion 
50 value. 

11. The method of any preceding Claim, further comprising the step of: 

using both said frame-difference and said field-difference motion values to select an algorithm for creating 
55 data for said missing pixel. 

12. The method of Claim 11 , wherein said step of calculating a frame-difference motion value comprising: 
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calculating a first frame-difference motion value equal to the absolute value of the difference between same- 
pixel following-row image data and prior-row prior-frame image data. 

13. The method of Claim 12, further comprising the step of: 

selecting a minimum of said first and second frame-difference motion values as said frame-difference motion 
value. 

14. The method of Claim 12 or Claim 13, further comprising the step of: 



10 



comparing said frame-difference motion value to a first threshold; 
said step of selecting a proscan algorithm based on said field-difference motion value step comprising the 
step of using said frame-difference motion value to select an algorithm for creating data for said missing pixel 
when said frame-difference motion value is less than said first threshold and using said field-difference motion 
is value to select an algorithm for creating data for said missing pixel when said frame-difference motion value 

is greater than said first threshold. 

15. The method of any of Claims 12 to 14, wherein said step of selecting further comprising: 

20 comparing said frame-difference motion value to a first threshold; 

comparing said frame-difference motion value to a second threshold, 

said selecting a proscan algorithm based on said field-difference motion value step further comprising: 
using said frame-difference motion value to select an algorithm for creating data for said missing pixel when 
said frame-difference motion value is less than said first threshold; 
25 using said field-difference motion value to select an algorithm for creating data for said missing pixel when 

said frame-difference motion value is greater than said second threshold. 

Using a weighted average of said frame-difference and said field-difference motion values to select an algo- 
rithm for creating data for said missing pixel when said frame-difference motion value is less than said first 
threshold and greater than said second threshold. 



30 



16. A logical mixer comprising: 

a first comparator outputting a selection signal indicating whether a first signal is greater than a threshold signal; 
a second comparator outputting a maximum signal equal to the maximum of said first signal and a second 
35 signal; and 

a selector receiving said selection signal, said first signal, and said maximum signal, said selector outputting 
said first signal when said first signal is less than said threshold signal and outputting said maximum signal 
when said first signal is greater than said threshold signal. 

40 17. The mixer of Claim 16, wherein a first threshold motion value and a second threshold motion value are providing 
the same threshold motion value. 

18 The mixer of Claim 16 or Claim 17, wherein said motion value for said pixel location is equated to a weighted 
* average of said minimum frame-difference motion value and said maximum motion value when said minimum 
45 frame-difference motion value is greater than said first threshold motion value and less than said second threshold 

motion value. 



so 
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